110 



fin m 



^j== M IN THE UNITED STATES ^^^o 

g PATENT AND TRADEMARK OFFICE gj<g Sh 

PATENT APPLICATION n ^ 

Gary C. Hess 
CASE 2 



TITLE METHOD FOR CONVERTING TABULAR DATA TO TEST SCRIPT 

USING A TEST GENERATOR 



ASSISTANT COMMISSIONER FOR PATENTS 
BOX PATENT APPLICATION 
WASHINGTON, D. C. 20231 



SIR: 



Enclosed are the following papers relating to the above-named 
application for patent: 

Specification 

8 Informal sheets of drawings (s) 
1 Assignment with Cover Sheet 
Declaration and Power of Attorney 



CLAIMS AS FILED 




NO. FILED 


NO. EXTRA 


RATE 


CALCULATIONS 


Total Claims 


38-20 = 


18 


18 X $18 


$324.00 


Independent 
Claims 


5-3 = 


2 


2 X $80 


$160.00 


Multiple Dependent 
Claim (s) , if applicable 


$260 = 


$0 


Basic Fee 




$710.00 




TOTAL FEE 


$1,194.00 



Please file the application and charge Lucent Technologies, Inc. 
Deposit Account No. 12-2325 the amount of $1,194.00, to cover the 
filing fee. Duplicate copies of this letter are enclosed. In the 
event of non-payment or improper payment of a required fee, the 
Commissioner is authorized to charge or to credit Deposit Account 
No. 12-2325 as required to correct the error. 



-1- 



Please address all correspondence to 

Thomason, Moser & Patterson, LLP 
Attorneys At Law 
595 Shrewsbury Avenue, Suite 100 
Shrewsbury, New Jersey 07702 



Respectfully submitted, 




Date Glenn B. Foster 

Reg. No. 32,676 
Attorney for Applicant (s) 



***EXPRESS MAIL CERTIFICATION* * * 

^Express Mail" mailing label number: EL708142281US 
Date of deposit: fyTT^foffT ?J ^u50 O 

I hereby certify that this patent application and 
related papers is being deposited with the United States Postal 
Service "Express Mail Post Office to Addressee" service under 37 
CFR 1.10 on the date indicated above and is addressed to the 
Assistant Commissioner of Patents, Box Patent Application, 
Washington, D.C. 20231. 

a 

Signature of person mailing paper or fee 

(VW\ cmAvc^ 

Name of person mailing paper or fee 



-2- 



HESS 2 

-1- 

TEST GENERATOR FOR CONVERTING A MODEL OF COMPUTER COMPONENT 
OBJECT BEHAVIOR AND STIMULUS VALUES TO TEST SCRIPT 

BACKGROUND OF THE DISCLOSURE 

5 1. Field of the Invention 

The present invention relates to computer 
testing and, more particularly, testing input to computer 
components such as graphical user interfaces (GUI). 

10 2. Description of the Background Art 

Test script is computer language that is input to, and 
executed by, an automated test executor. The automated 
test executor simulates user input to a computer component 
such as a graphical user interfaces (GUI), computer 

15 hardware, or a computer software of a target computer. The 
automated test executor tests the response in one or more 
network locations to simulated inputs to the computer 
component. Such simulated inputs, in e.g. a GUI, include 
clicking a mouse, moving a mouse, or typing a prescribed 

20 text string. GUI's are considered one embodiment of a 

front end of a computer that includes the components that 
make up the screen that forms the application. Since 
computer components such as GUIs are becoming more complex 
as to be able to provide an almost unlimited number of user 

25 interface and computer operation scenarios, the complexity 
of the operation of the automated test executors that test 
the computer component is also increasing. Testing the 
computer component for desired operation can almost be as 
difficult and time consuming as writing the software for 

30 the computer component. 

Test data input is manually "recorded". For a GUI, a 
human tester manually enters test data in the form of test 
script that, upon execution in the automated test executor, 
simulates input to the computer component (s) under test. 
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To test computer components such as GUIs, the tester 
typically manually inputs data, manually moves mouse 
pointer, simulates mouse clicking, and manually captures 
the results of the GUI from the user inputs. For tests to 
5 be re-executed multiple times, e.g. regression tests, the 
automated test executor may provide a special "record" 
feature to be used before test execution. The automated 
test executor then executes the generated test script, and 
the results output from the automated test executor are 

10 reviewed, recorded, and/or compared to the desired 

operation of the target computer. The automated test 
executor automatically simulates such actions as 
manipulating mouse pointers or keyboard closures, in 
response to the input test script to simulate user input. 

15 The response throughout the network to the test script 
executed by the test executor can be captured for later 
replay and review. The recorded results from the automated 
test executor are then passed through an analysis engine. 
The analysis engine is typically manually performed to 

20 determine which test executions were successful. The 

analysis engine also tabulates the recorded results, such 
as a pass or fail status for each executed test. 

It is also possible to include analysis functions 
within the test script code to provide immediate status 

25 determination for a test case. Failed test cases are 
typically reviewed manually with the human readable 
component of the test case output, and the recorded results 
are examined manually for determination of the scope of the 
defect. Specific test cases are re-executed through the 

30 automated test executor, if necessary, either automatically 
or manually to consider the operation of the automated test 
executor. A description of the defect may then be entered 
into a trouble tracking system, along with a test case 
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identifier so coders or programmers can modify the 
operation, e.g. software code, of the GUI to correct the 
defect . 

There is the need to allow testers to concentrate 
5 their efforts on devising specific tests rather than on the 
details of the test script generation or modification 
within the scope of testing and the use of automated test 
executors for computer components such as GUI , computer 
software, and/or computer hardware. The test script 

10 generation and modification themselves utilize code similar 
to programming code, i.e. an object oriented code. Thus 
there is a need in the art for a system that can convert 
stimulus values provided by a tester, and a model of the 
computer component object behavior to the test script that 

15 can be executed by automated test executors. The 

behavioral output of the system to simulated input to the 
computer component under test can be compared to expected 
results . 

20 SUMMARY OF THE INVENTION 

The invention relates generally to a method and 
associated apparatus for testing. More particularly, this 
invention relates to an apparatus that tests the response 
of a computer component to inputs. The apparatus includes 

25 a modeler, a tester, and a test generator. The modeler 

provides a model of the computer component object behavior. 
The tester provides stimulus values to be applied to the 
computer component object. The test generator converts the 
model of the computer component object behavior and the 

30 stimulus values into test script. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The teachings of the present invention can be readily 
understood by considering the following detailed 
description in conjunction with the accompanying drawings, 
5 in which: 

FIG. 1 shows a block diagram of one embodiment of a 
network including a target computer, a network computer, 
and a test generator computer that can be used in a test 
generation process ; 
10 FIG. 2 shows a block diagram of another embodiment of 

a target computer that can be used in a test generation 
process ; 

FIG. 3 shown one embodiment of a flow chart of a test 
method including modeler input, tester input, a test 
15 generator, and an automated test executor; 

FIG. 4 shows one embodiment of a state model window 
for a sample-input table; 

FIG. 5A shows one embodiment of a computer component, 
e.g. GUI, to be tested; 
20 FIG. 5B shows one embodiment of state model that 

defines the states shown in the display shown in FIG. 5A; 

FIG. 6 shows one embodiment of a table including 
stimulus inputs to be input to a test generator process of 
the FIG. 5A model; 
25 FIG. 7 shows one embodiment of a test generator 

computer display displaying a portion of generated test 
script that can be applied to the automated test executor 
of FIG. 3; 

FIG. 8 shows a flowchart of one embodiment of a method 
30 performed by a test generator; 

FIG. 9 shows one embodiment of a table including 
stimulus values as input by the tester of the test 
generator of FIG . 3 ; 
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FIG. 10a shows one embodiment of a model object as 
created by the modeler to simulate the input to a target 
computer component, e.g. a graphical user interface (GUI); 
FIG. 10b shows one embodiment of pseudocode that 
5 represents the operation of the model object of FIG . 10a; 
and 

FIG. 11 shows one embodiment of pseudocode for 
converter logic used by the test generator of FIG. 3. 

To facilitate understanding, identical reference 
10 numerals have been used, where possible, to designate 
identical elements that are common to the figures. 

DETAILED DESCRIPTION 

FIG. 1 shows one embodiment of a network 100 that can 

15 utilize a test generator as described herein. The network 
100 comprises a network computer 102, a target computer 
104, and a test generator computer 106. The network 
computer 102 is envisioned to be, e.g. a server that stores 
spreadsheet, database, data and/or programs accessed by the 

20 target computer 104. The network computer 102 can be a 
server that, e.g., the target computer 104 (including a 
browser) communicates with to establish network, Internet, 
or Intranet connection. The network computer 102 is 
optional in this embodiment. 

25 The target computer 104 includes a computer component, 

such as a graphical user interface (GUI), computer 
software, or computer hardware that is under test. The 
target computer 104 is envisioned be a client computer or a 
stand alone computer that comprises a central processing 

30 unit (CPU) 160, a memory 162, an input output interface 
(I/O) 164, a circuit portion 165, and a bus, not shown. 
The target computer 104 may be a general-purpose computer, 
an electronic circuit that responds to input signals, a 
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microprocessor, a microcontroller, or any other known 
suitable type of computer. The CPU 260 performs the 
processing and arithmetic operations for the target 
computer 104. The target computer 104 interprets 
5 instructions from the automated test executor, (e.g., 
simulated key click, mouse movement, text input, etc.) 

The memory 162 includes random access memory (RAM) and 
read only memory (ROM) that together store the computer 
programs including a network browser, operands, operators, 

10 dimensional values, configurations, and other data and 
computer instructions that are used to control the 
operation of test generator. The bus provides for digital 
information transmissions between CPU 160, circuit portion 
165, memory 162, I/O 164, and other portions of the network 

15 100 that either receive digital information from, or 
transmit digital information to, target computer 104. 

I/O 164 provides an interface to control the 
transmissions of digital information between each of the 
components in target computer 104, and between the 

20 components of the target computer 104 and different 

portions of the network 100, e.g. the network computer 102 
and/or the test generator computer 106. Circuit portion 
165 includes all of the other user interface devices such 
as a display 167 and a keyboard, system devices, and other 

25 accessories associated with the target computer 104. 

The display 167 of the target computer 104 typically 
utilizes a graphical user interface (GUI) also shown as 
167, as is known in the art. GUI allows the user of the 
target computer 104 to "interact" with the target computer 

30 using such target computer inputs as, e.g., a mouse or a 
keyboard. There are three basic categories of GUI 
components: windows, menus, and controls. These three 
components are used in conjunction with each other to 
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provide the window functionality. "Windows" are areas of 
the user's display device, often rectangular, that are 
displayed under the control of the target computer. 
Examples of windows include text windows, main windows, 
graphics windows, and dialogue boxes. "Menus" are GUI 
constructs that can be selected by, e.g. positioning a 
pointer over the menu and clicking a mouse, to display a 
new client window. Examples of menus include menu bar and 
a menu box. "Controls" are GUI constructs that allow the 
user to transmit commands or information to the GUI of the 
target computer. Examples of controls includes spin 
controls, scroll bars, radio boxes, push buttons, list 
boxes, labels, text boxes, and check boxes. 

In one embodiment, the target computer 104 includes a 
computer component that is to be tested. The computer 
component under test may be included in the GUI 167 or any 
computer software stored in the memory 172 of the target 
computer 104 (or one or more of the memories of the network 
computer 102 and/or the test generator computer 106) . 
Alternatively, the computer component under test may be 
computer hardware in any one of the computers 102, 104, 
and/or 106. Simulated input to the computer component by 
the automated test executor under test results in state 
changes to computers 102, 104, and/or 106. The state 
changes in computers 102, 104, and/or 106 may be monitored, 
recorded, and/or reviewed. 

The test generator computer 106, that is distinct 
from, but communicates with, the target computer 104 in the 
embodiment shown in FIG. 1, comprises a central processing 
unit (CPU) 170, a memory 172, an input output interface 
(I/O) 174, a circuit portion 175, and a bus, not shown. 
The test generator computer generates test cases by 
converting input information including a model of the 
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computer component object behavior and stimulus values to 
test script. The test script is executed by an automated 
test executor. In the embodiment shown in FIG. 1, the 
automated test executor is a process included as an 
5 application that is run by either the test generator 

computer 106, the target computer 104, the network computer 
102, or two or more of computers 102, 104, and 106. The 
test generator computer 106 may be a general-purpose 
computer, a microprocessor, a microcontroller, or any other 
10 known suitable type of computer. The CPU 17 0 performs the 
processing and arithmetic operations for the test generator 
computer 10 6. 

The memory 172 includes random access memory (RAM) and 
read only memory (ROM) that together store the computer 

15 programs, operands, operators, dimensional values, system 
configurations, and other parameters that control the test 
generator operation and the generation of test script to be 
used by the automated test executor. The bus provides for 
digital information transmissions between CPU 170, circuit 

20 portion 175, memory 172, and I/O 174. The bus also 

connects I/O 174 to the portions of the network 100 that 
either receive digital information from, or transmit 
digital information to, test generator computer 106. 
I/O 174 provides an interface to control the 

25 transmissions of digital information between each of the 
components in test generator computer 106. I/O 174 also 
provides an interface between the components of the test 
generator computer 106 and the target computer 104. 
Circuit portion 175 comprises all of the other user 

30 interface devices such as displays and keyboards, system 
devices, and other accessories associated with the test 
generator computer 106. The I/O 174 includes a display 
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screen that is used to display models and/or code that 
characterize the operation of the test generator computer. 

In the embodiment network 100 shown in FIG. 1, the 
test generator computer 106 computer simulates input to the 

5 target computer by converting data into test script that is 
applied via an automated test executor to the computer 
component of the target computer 104. The test generator 
computer may be used, in the embodiment shown in FIG. 1, to 
monitor, record, and/or review the response of the target 

10 computer 104, the network computer, or the test generator 
computer to input to the computer component (e.g., the GUI , 
the computer software, the computer hardware, and/or other 
component (s) ) of the target computer 104. The disclosure 
describes testing the response of one or more computers 

15 102, 104, and/or 106 in the embodiment shown in FIG. 1 to 

input to a GUI associated with the target computer 104. It 
is envisioned that the concepts described herein may also 
be applied to testing of GUIs, computer software, computer 
hardware, or other computer components, such as electronic 

20 circuit boards and network interfaces, located in one or 

more of computers 102, 104, and/or 106. The test generator 
computer process executed by the test generator computer 
106, the target computer 104, or the network computer 102 
(FIG. 1) generates the test script that is executed by the 

25 automated test executor. 

The test script input to the target computer simulates 
an input into, or records an output from, the target 
computer, the network computer, or the test generator 
computer. For instance, one test script command may relate 

30 to selecting one window in the GUI of the target computer 
at a prescribed location. Another test script command may 
relate to clicking on a selected window in the GUI to make 
a selected window active. Another test script command may 
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relate to typing a prescribed text string into an active 
GUI window. Yet another test script command may relate to 
recording the text that is contained in a prescribed GUI 
window. Several test script commands may indicate, e.g. to 
position a pointer to a prescribed location (text window in 
the GUI of the target computer) , and simulate a mouse key- 
click to make that window active, and as such the window is 
enabled to receive text input. Another test script command 
can simulate inputting a string of text into an enabled 
window. The test script can simulate a mouse pointer move 
to another location in the GUI and a mouse click. The 
state/data contained within the GUI, the target computer, 
the test generator computer, and/or the network computer 
can be recorded before, during, or after any particular 
test script action that may be utilized to understand the 
results of that particular test script action. The test 
script input into the automated test executor therefore can 
be used to simulate user input into the GUI, or other 
computer component, of the target computer 104. 

In the embodiment shown in FIG. 1, a separate test 
generator computer 106 interacts with the target computer 
104 to perform the test generation function, the automated 
test executor function, and/or any one of the other 
functions shown in FIG . 3. In the embodiment shown in FIG. 
2, the processes performed by the test generator computer 
106 and the target computer are performed by a single 
target computer 104. An optional network computer 102, as 
shown in the embodiment in FIG. 1, is shown in the 
embodiment in FIG. 2 with which the target computer 104 may 
interact. The target computer 104 in FIG. 2 runs target 
computer processes either alone or in combination with the 
network computer 102, e.g. GUI, computer software, or 
computer hardware processes. The target computer 104 also 
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runs test generator processes either alone or in 
combination with the network computer 102. 

The tester function and the modeler function are two 
interrelated functions associated with the test generator 
5 process. In testing the response of one or more computers 
of the network 100 of FIG. 1 to input to the GUI, computer 
software, and/or other computer components, there are 
functions that are most concerned with system requirements 
of the test, i.e. system functions. The tester understands 

10 system requirements such as which fields may optionally be 
populated and which fields must necessarily be populated, 
and what data is valid for a specific field, e.g. numbers 
may not be permitted in certain fields. Other examples of 
system requirements that are prepared by the tester in a 

15 preferred embodiment include a particular field in a 

spreadsheet contains data such as letters and not numerical 
data; or that numbers in a particular field are within a 
prescribed minimum or maximum range, etc. There are also 
functions that are concerned with the testing requirements 

20 of the GUI. The modeler is trained to understand and 

relate to the testing requirements, e.g. what type of field 
is used, which components are to be used on the screen, 
which font is to be used, etc. The modeler does not 
necessarily understand the system requirements relating to 

25 the application. Examples of testing requirements that are 
understood, used, and/or prepared by the modeler include 
requiring that a field in a particular application (such as 
a spreadsheet) should be located at a particular position 
in a window, requiring the table of the spreadsheet or 

30 database to have a particular "look and feel", requiring 
that windows, menus, or controls in the GUI should have a 
specific dimension and be positioned at a specific 
position, ability to generate or display output, and/or 
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ability to accept input, etc. The modeler function and/or 
the tester function can be performed either by a human, or 
alternatively be automated. 

FIG. 3 shows a test script generation method that 
5 involves the use of tabular data (i.e. data relating to a 
spreadsheet, database, etc.) representing boundary values, 
etc. The tabular data is converted into test script that 
simulates input to the automated test executor using a test 
generator. The test script is run by the automated test 

10 executor of the target computer, and the results are 
recorded or compared to expectant values. 

FIG. 3 shows one embodiment of a process diagram 300 
that is run between the test generator computer 106 (of 
FIG. 1) , the network computer, and/or the target computer 

15 104 of FIG. 1. The process diagram 300 tests the 

response (s) of computers 102, 104, and/or 106 to simulated 
input to a computer component under test such as a GUI, 
computer software, or computer hardware. The process 
diagram involves the conversion of data into test script, 

20 the execution of the test script by the automated test 

executor, and the recording, tabulation, and review of the 
results from the automated test executor. The process 
diagram 300 is segmented to include test input 302 and a 
test output 304. The test input 302 includes a modeler- 

25 input segment 306, a tester input segment 308, and a 
conversion segment 310. 

The modeler input segment 306 includes block 314 and 
block 316. In block 314, the modeler analyzes the computer 
component and testing requirements. In block 316, the 

30 modeler designs the model. One embodiment of the 

preparation of the model object is shown in FIGs. 10a and 
10b. The tester input segment 308 includes blocks 320 and 
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322. In block 320 the tester determines the system 
requirements . 

FIG. 10a shows one embodiment of a representation of a 
target GUI window. FIG. 10b shows one embodiment of 
5 pseudocode, such as would be prepared by the modeler, that 
would be input to the test generator process 310 to 
generate a model object. The specific pseudocode in FIG. 
10b relates to simulating positioning the mouse pointer to 
a GUI of the target computer 104 of FIG. 1, and clicking 

10 the mouse. The code shown in FIG. 10b is preferably 
provided in an object oriented code, which may be 
understandable to the automated test executor. The model 
prepared by the modeler can be populated with stimulus 
values provided by the tester. These stimulus values, such 

15 as boundary conditions, mouse clicks, button selections, 
etc. test the response of the computer component to 
prescribed simulated input. Stimulus values are considered 
as those represented by tabular value input for boundary 
conditions, etc. that are used as input to the test 

20 generator 310 of FIG. 3 and that are combined with a model 
to be converted by the test generator into test script. 

In block 322, the tester prepares the stimulus values 
to be input into the spreadsheet or database. The stimulus 
values may include boundary parameters containing one or 

25 more values for certain fields that are outside the 

prescribed allowable ranges for that field, as well as 
other values that are within prescribed limits. The 
stimulus values may also include, e.g., tabular data such 
as a form that may be contained in a spreadsheet or 

30 database, written or oral (i.e. speech recognition) 
instructions to the computer, etc. 

One embodiment of general stimulus value input from 
the tester is shown in FIG. 9. The generic stimulus values 
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labeled in FIG . 9 as "action-value", is input to the test 
generator process. The stimulus values are arranged in the 
form of a table in FIG. 9, though the stimulus values may 
take the form of boundary parameters, written or oral 
5 instructions to a computer, etc. 

The output from the tester input segment 308 and the 
output from the modeler input segment 306 are combined in 
block 310 in the embodiment of FIG, 3, in which the test 
generator generates test cases by converting the combined 

10 stimulus values and model into test script. 

The logic used by the target computer 104, the network 
computer 102, and/or the test generator computer 106, of 
FIG. 1, in converting the data input to the test generator 
by the respective tester and modeler, is shown respectively 

15 in FIG. 9 and 10. The logic used to convert the stimulus 
values and the model into test script is shown in FIG. 11. 
The FIG. 11 converter logic may be performed in the network 
computer 102, the target computer 104, and/or the test 
generator computer 106 in the embodiment of FIG. 1. The 

20 LOOP X and LOOP Y statements input the stimulus values 
input from the tester as shown in FIG. 9. The three 
"Assign Var" statements apply the stimulus value to the 
test object, the test object being modeled by the modeler. 
The "Apply Value" statement acts to append the applied 

25 stimulus value as test script that is in a form that can be 
input to the automated test executor. The record action 
statement is optional, and may provide an alternate format 
of the test script in a human readable format to be used 
by, e.g. a human tester. The test script in readable 

30 format can be used in the analysis engine 328 in FIG. 3. 
Alternatively, the human readable test script can be 
analyzed if the test case fails. 



HESS 2 

-15- 

The test script contains computer instructions that 
will simulate input to the computer component , e.g. GUI, 
computer software and/or computer hardware of the target 
computer. Boundary values, e.g., stimulus values that are 
5 both within and without the prescribed limits of the 

computer component under test, test the operation of the 
computer component and/or the response of computers 102, 
104, and 106 to the input on the computer component. These 
computer instructions are executed in the automatic test 

10 executor process that resides in the computers 102, 104, 
and/or 106. The displayed or stored results after 
application of the stimulus values to the GUI, or the 
computers 102, 104, and/or 106 of FIG. 1 are monitored, 
recorded, or reviewed. 

15 The test output 304 includes blocks 324, 326, 328, 

330, and 332 as shown in the embodiment of FIG. 3. Block 
324 is an automated test executor execution block. The 
automated test executor preferably consists of a program 
running on the same target computer that is executing the 

20 GUI, though portions of the automated test executor may 

also be running on the network computer 102 and/or the test 
generator computer 106 of the embodiment of FIG. 1. Test 
script is the language of the automated test executor. The 
automated test executor simulates actions that a user 

25 interacting with the GUI of a target computer would 

perform, e.g. moving a mouse, clicking a mouse, entering 
text using a keyboard. The automated test executor may be 
considered as an application program running in addition to 
the operating system(s) of the network computer 102, the 

30 target computer 104, and/or test generator computer 106 of 
the embodiment of FIG. 1. 

One embodiment of automated test executor is 
commercially available as Silktest®. With commercially 
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available test executors, the tester trains the automated 
test executor by manually entering a test case as the 
automatic test executed records the outcome. The test 
script generated by the test generator that is input to the 
5 automated test executor causes the automated test executor 
to perform a prescribed operation. These recorded actions 
are in the form of test script that may be later used for 
automatic test execution. The automated test executor 324 
of the embodiment of FIG. 3 also has capabilities to record 

10 results in the computer component, and/or the computers 

102, 104, and/or 106 of FIG. 1 to stimulated input to the 
computer component (e.g. GUI, computer hardware, and/or 
computer software in response to test script commands 
received from the test generator 310 of the embodiment of 

15 FIG. 3. Block 326 is a record results block that is 

typically manually performed. The results of the tested 
application operations as well as the results from the 
automated test executor execution are recorded in block 
32 6. Such recording may be included in the form of 

20 generated test script. The results from the automated test 
executor execution includes, e.g., that a specific window 
could not be opened because too many windows are presently 
opened . 

Block 328 is an analysis engine block in which the 
25 results are tabulated. The analysis engine block is 

typically performed manually, though it may be automated. 
The recorded results from block 326 are input to the 
analysis engine. The automated test executor determines 
which test executions were successful and which test 
30 executions encountered failed for one reason or other. The 
analysis engine tabulates the recorded results, such as 
providing a Pass or Fail status. As a result of automating 
the automated test executor, the automated test executor 
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can run for extended time without human interaction to 
provide a more rigorous test of the operation of the GUI. 
The automated test executor can therefore provide a large 
number of results. The analysis engine goes through all 
5 results and, e.g., tabulates error conditions. This 
tabulation provides for more efficient review of the 
automated test executor results than if the results were 
simply reviewed manually. The tester then periodically 
reviews the tabulated results output from the analysis 

10 engine. It is also possible to incorporate analysis 

functions within the test script code for immediate status 
determination . 

In block 330, the failed test cases are manually 
reviewed with the human readable component of the test case 

15 output and the recorded results are examined manually for 
determination of the scope of the defect. Specific test 
cases can be re-executed if necessary either automatically 
or manually. In block 332, detected defects are added to a 
trouble tracking system. A description of the defect is 

20 entered into a trouble tracking system, along with a test 
case identifier. The trouble tracking system is utilized 
by, e.g., programmers, coders, and testers. In the code 
generation process, the code of the application program in 
the target computer, under test by the test executor, can 

25 be corrected or re-written by coders and programmers to 
remedy the code defects noted in the trouble tracking 
system. 

The test generator 310, one embodiment of which uses 
the Model Reference Technology as with the TESTMASTER® 
30 program of TERADYNE, INC of Boston, MA, is used to generate 
test cases. These test cases consist of multiple 
components , principally: 
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A. A test script that is in a form that can be input into, 
and understood by, an automated test executor such as 
Segue' s SILKTEST® from Segue Software, Inc.; and 

B. An optional human readable portion describing each test. 

Other components of the test generator may include: 

C. A test controlling file for a Test Manager, one 
embodiment of which uses TESTEXPERT® from Silicon Valley 
Network; 

D. An expected results file for comparison after test 
execution; 

E. Executable script or code that obtain expected test 
results independently of the test itself; 

F. Executable script or code to pre-set or reset a device, 
file, or database. 

Components C to F may be separate entities from, or 
part of, the principal components. The test script 
H 20 (component "A" above) contains fabricated commands 
LJ generated specifically for each particular test. Such 

commands simulate potential user input, and these commands 
may provide for test control, test monitoring, results 
recording, and test status. 
25 The automated test executor using test script from the 

test generator tests the operation of the GUI of the target 
computer to simulated user input. The input to run the 
test generator for this embodiment can be subdivided into 
two basic functions: the tester function and the modeler 
30 function. The tester function relates to the system 
requirements (for instance, documented features) and 
provides tabular data for the spreadsheet or database that 
represents user input. The modeler function relates to the 




HESS 2 



tester requirement and analyzes the needs of the tester. 
The modeler function, e.g., generates the headings for the 
spreadsheet or database, the look and feel of the GUI, etc. 
It is likely that one particular modeler would be 
5 associated with a particular database or spreadsheet, and 
would structure the model in a manner that input can be 
received from one or more testers. It is possible that the 
different testers have input to the tabular data in 
different formats. The modeler may configure the model to 

10 be able to receive data from each one of a plurality of 
distinct testers, and each of the testers may provide 
tabular data in a different format. The tester knows what 
is to be tested but doesn't have to go through the effort 
of creating the test script. This embodiment provides for 

15 an effective division of work between the modeler and the 
tester . 

Depending on the tester's needs, the modeler would 
design a model representing the behavior of the computer 
component to test aspects of the computer components 

20 characteristics (for instance, size or color of a window of 
a GUI), ability to generate output (for instance, a text or 
graphical display of an object in a GUI), ability to accept 
input (for instance a mouse click or keyboard text entry to 
be input to a GUI), or navigation linkages, e.g., 

25 transferring control between different windows of a GUI. 
Oftentimes, the tester is concerned with testing a user 
scenario of entering data in multiple fields and on 
multiple windows. The tester's data entries would be 
converted by the model into the test script code used for 

30 this testing. 

The use of the disclosed conversion code, one 
embodiment of which is shown in FIG. 11, allows for the 
conversion of test cases written for manual testing to be 
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converted to automated test script. The disclosed method 
may also be used to generate functional tests before the 
final program code is available, thereby enabling the 
testers to more efficiently carry out their testing 
responsibilities . 

System requirements embodiment of the of test generator 
310 shown in FIG. 3 including the modeler input of the 
model object , one embodiment shown in FIGs . 10a and 10b; 
the stimulus value input by tester in the embodiment shown 
in FIG. 9; and the embodiment of conversion process to test 
script shown in FIG. 11 includes: 

A. The capability to prepare information in the form to be 
tested on the component to be tested such as spreadsheet 
information, to be input into the GUI, computer 
software, or computer hardware of the target computer. 

B. Interoperability of the test generator with model 
designated by modeler, the modeler not being familiar 
with system requirements but being familiar with testing 
requirements ; 

C. The capability to generate test cases; 

D. The capability to convert the system requirements and 
the testing requirements into test script in a form that 
can be understood by automated test executor; and 

E. The capability to feed test script into the automated 
test executor to test a computer component of the target 
computer . 

The tabular data may be generated from another model 
or the front end portion of this disclosed method's test 
generation model, rather than from a human tester. The 
modeler can rely on the tester's knowledge and test 
experiences as input to the model. 
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FIG. 5A shows one embodiment of a main window 500 that 
appears on the GUI 167 in the embodiment of FIG . 1 of the 
target computer. In this disclosure, the computer 
component under test is exemplified by the GUI 167 of the 
5 target computer in the embodiment shown in FIG. 1. The 
main window 500 is an integral portion of the GUI. The 
input over the main window 500 is simulated by the test 
script generated by the run test generator block 310 in 
FIG. 3. The test script is executed by the automated test 

10 executor to simulate the input to the computer component, 
e.g. GUI 167 in FIG. 1, under test. A user may select 
prescribed windows in the test generator computer by 
selecting the window menus 502b to 502f shown in a main 
window 500 to be displayed in a GUI. 

15 The main window 500 of the target GUI comprises a main 

window field 502, a plurality of menu fields 502b to 502f, 
and a plurality of control fields 504a to 504e and 506a to 
506g. The window field 502 comprise, e.g., main window 
506. The menu fields comprise, e.g., a CLLI window menu 

20 502b, TRKGRP window menu 502c, a TRKSGRP window menu 502d, 
an ISUPDEST window menu 502e, and a CLLICDR window menu 
502f . Clicking on any of the window menus 502a-502f will 
cause the window corresponding to that particular window 
menu to appear as the active window 500. The control 

25 fields 504 include, e.g., an OK control 504a, and apply 

control 504b, a reset control 504c, a cancel control 504d, 
a help control 504e, and a plurality of controls 506a to 
506g associated with the main window 500. Selecting any of 
the selection controls 504a to 504e will cause the test 

30 generator computer 106 to perform the action indicated in 
the particular selection control. 

The main window 500 includes a plurality of control 
fields 506 that comprises, e.g., an order ID field 506a, a 
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switch name field 506b, a release method field 506c, a 
release date/time field 506d, a status field 506e, and a 
comment field 506f . The user may input data into each of 
the control fields 506a to 506g to cause the test generator 
5 computer 106 to generate and put into the target computer 
104 that simulates an action, such as may represent a 
single computer instruction to the target computer. 

FIG. 5B is a state model diagram that models potential 
control or menu selections by the user that models the 

10 operation of the main window 500 of FIG. 5A. The state 

model diagram represents the logic that may be applied to 
the main window 500 of the GUI by the test generator 
process 310 combined with the test execution process of 
FIG. 3. The controls 504a to 504e on the main screen 500 

15 of FIG. 5A are represented by respective states 512a to 

512e of FIG. 5B. The menus 502a to 502f on the main screen 
500 are represented by respective states 512g to 512p. The 
connectors 514, only a few of which are numbered, represent 
the various permitted successive paths between the 

20 different states that the test generator generates the test 
script input into the automated test executor instructs the 
target computer to follow. Certain ones of the connectors 
514 includes model transmission icons, labeled as "T" in 
the embodiment shown in FIG. 5B. For example, if the GUI 

25 of the target computer 104 is in state 512n, and the 

TRKSGRP menu 502C in FIG. 5A is selected, then the logic 
diagram in FIG. 5B indicates that the test generator should 
instruct the GUI target computer to be in state 512 j . The 
test generator computer 106 functions by monitoring, 

30 recording, and/or ensuring that the target computer 

properly follows through the various states 512a to 512n 
according to the input from the test generator computer. 
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In FIG . 6, each test case representing input to be 
converted by the test generator to test script is stored as 
a separate row 608a to 602d. Each row 602a to 602d 
includes one entry represented by a plurality of columns 
5 604a to 604k. Each column entry 604a to 604k of each row 
602a to 6502d represents one data field for one menu or 
control input that has been applied to the window shown in 
FIG . 5A. For example, field 604c represents a task as 
performed on selecting a certain field in the target 

10 computer 104 of FIG. 1, as indicated in the states 514a to 
512n, shown in FIG. 5B. As such, FIG. 6 includes the 
specific spreadsheet stimulus values input to the model, as 
indicated generally in FIG . 9. Each row 602a to 602d 
represents one test case for the main window 500 of the 

15 computer component, e.g. GUI 167 in the embodiment of FIG. 
1, of the target computer shown in FIG. 5A. 

FIG. 7 shows a portion of an output program from a 
test generator including generated test script generated in 
response to input test cases including stimulus values of 

20 the type shown in FIG. 6. The test script is applied to 
the automated test executor. The automated test executor 
thereby simulates input in the computer component, e.g. GUI 
167 in the embodiment of FIG. 1, of the target computer 
that can be, e.g. monitored, analyzed, and/or recorded. 

25 Each line 702a to 702f in FIG. 7 represents a generated 

line of test script that represents a portion of a program 
to be input to the target computer component, which was 
generated in response to the input, as indicated in rows 
602a to 602d in FIG. 6. The lines of the generated test 

30 script lines 702a to 702f is executed by the automated test 
executor to simulate input to the target computer 104 of 
FIG. 1 is representative of a portion of the complete test 
script. The automated test executor test script execution 



HESS 2 

t24- , 

actions are performed by a user on the GUI of the target 
computer itself. As such, the output on the display of the 
target computer should reflect the input test script as 
being applied by the test generator computer. 

Though FIG. 1 shows a distinct test generator computer 
106 from the target computer 104, it is considered possible 
that a test generator is actually a separate process 
running within the target computer itself. As such, the 
target computer can generate test data that is executed by 
itself via the automated test executor function. 

FIG. 8 is a flowchart of one embodiment of a test 
generation method 800 of the test generator process that is 
generated by one or more of computers 102, 104, and/or 106 
in the embodiment of FIG. 1. The method 8 00 can be 
subdivided into four sections. The first section 802 is 
concerned with bringing up the application and is used once 
prior to executing the test case(s). Initially, the 
procedure may be performed manually by the tester. The 
second section 804 of the method 800 selects the Window of 
the GUI in the target computer under test, and the second 
section begins the test case of each window associated with 
each test case. A test generator such as TESTMASTER® would 
use the code associated with the second section to start 
each test case. The third section 806 of the method 800 
provides code segments for each object under each tab 
heading for the GUI Window under test. The third section 
806 is used by the test generator to form the specific test 
case. Various fields corresponding to test case data would 
be substituted by variable data representations within the 
test generator. The fourth section 808 provides a function 
call and the underlying functions to facilitate the 
selection of a popup choice. With one function declaration 
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in the model, the use of the function call reduces the 
number of lines generated for the test cases. 

The first section 802 includes blocks 810, 812, 814, 
816, and 818. The method 800 starts with block 810 in 
5 which the active browser, e.g. NETSCAPE NAVIGATOR® or 

INTERNET EXPLORER®, is set. The method 800 continues to 
block 812 in which the active web site, according to a 
prescribed URL selected by the user, is selected. The 
method 800 continues to block 814 in which the task 

10 execution icon is selected. The method continues to block 
816 in which the login window is completed. The method 
continues to block 818 in which a new task order window is 
opened that represents opening an application specific 
window, such as Microsoft WORD, EXCEL, etc. The first 

15 section 802 is performed prior to the test generator 
generating the test script as per block 310 of FIG. 3. 

The second portion 804 includes blocks 820, 822, and 
824. In block 820, the method 800 sets the active window. 
In block 822, the method 800 provides a list (e.g. pop up) 

20 by which the user can select the desired input. The 

method 800 continues to block 824 in which the controller 
receives input from the user as to the selected window. 

The third portion 806 includes block 830 in which the 
dynamic modeling information for the test script is 

25 commenced. In block 830, the specific test case is formed. 

The fourth portion 808 includes blocks 840 and 842. 
In block 840 the function call is created. In block 842 
the underlying function is created to facilitate accessing 
the pop-up choice. 

30 Although various embodiments that incorporate the 

teachings of the present invention have been shown and 
described in detail herein, those skilled in the art can 
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readily devise many other varied embodiments that still 
incorporate these teachings. 
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CLAIMS 

What is claimed is: 

1. A method of generating test script that can be read by 
5 automated test executor comprising: 

inputting stimulus values and a model of a computer 
component object behavior into a test generator; and 

converting said stimulus values and the model of a 
computer component object behavior to test script. 

10 

2. The method of claim 1, further comprising a tester 
input . 

3. The method of claim 2, wherein the tester inputs the 
15 stimulus values. 

4. The method of claim 3, wherein the tester understands 
system requirements , and wherein the stimulus values are 
prepared in response to the system requirements. 

20 

5. The method of claim 1, further comprising a modeler 
that designs a model. 

6. The method of claim 5, wherein the stimulus values are 
25 converted to test script in response to the model of the 

computer component object behavior designed by the modeler. 

7. The method of claim 5, wherein the modeler designs the 
model of the computer component object behavior in response 

30 to testing requirements. 

8. The method of claim 1, wherein the test script is 
executed by a test executor. 
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9. The method of claim 8, wherein results are generated 
in a computer network that includes the computer component 
in response to the executed test script. 

5 

10. The method of claim 9, wherein said results are 
tabulated. 

11. A method of inputting data into a test generator , 
10 comprising: 

inputting system requirements into the test generator; 

inputting testing requirements into the test 
generator, wherein testing requirements are input from a 
separate source from the system requirements; and 
15 converting the testing requirements and the system 

requirements into test script 

12. The method of claim 11, wherein a tester inputs the 
system requirements. 

20 

13. The method of claim 11, wherein a modeler inputs the 
testing requirements. 

14. The method of claim 11, wherein a test executor tests 
25 the response of a computer component to the test script. 

15. The method of claim 11, further comprising generating 
test script in response to the system requirements and the 
testing requirements . 

30 

16. The method of claim 15, further comprising executing 
the test script. 
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17. The method of claim 16, wherein results are generated 
in response to the executed test script. 

18. The method of claim 17, wherein the results are 
5 tabulated. 

19. An apparatus that inputs data into a test generator, 
comprising : 

a first input that inputs system requirements into the 
10 test generator; 

a second input, distinct from said first input, that 
inputs testing requirements into the test generator; and 

a converter that converts the system requirements and 
test requirements to test script. 

15 

20. The apparatus of claim 19, further comprising a tester 
that applies the system requirements to said first input. 

21. The apparatus of claim 19, further comprising a 
20 modeler that applies the testing requirements to said 

second input. 

22. The apparatus of claim 19, wherein a test executor is 
used to test the response of a computer component to the 

25 test script. 

23. The apparatus of claim 19, wherein the test generator 
generates a test script in response to the input system 
requirements and the input testing requirements. 

30 

24. The apparatus of claim 23, further comprising a test 
executor that executes test script generated by the test 
generator . 
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25. The apparatus of claim 24 , wherein results occur in a 
computer component of a network in response to the executed 
test script. 

5 

26. The apparatus of claim 25, further comprising an 
analysis engine that tabulates the results in the network, 

27. A method to test response of a computer component to 
10 inputs comprising: 

providing a model of the computer component object 

behaviors- 
providing stimulus values to be applied to the 

computer component object; and 
15 converting the model of the computer component object 

behavior and the stimulus values into test script. 

28. The method of claim 27, wherein an automated test 
executor executes the test script. 

20 

29. The method of claim 27 , wherein a modeler provides 
said model of the computer component object behavior. 

30. The method of claim 27, wherein the object behavior of 
25 a graphical user interface (GUI) is said computer component 

object behavior. 

31. The method of claim 27, wherein the object behavior of 
computer hardware is said computer component object 

30 behavior. 
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32. The method of claim 27, wherein the object behavior of 
computer software is said computer component object 
behavior . 

33. The method of claim 27, wherein a tester provides the 
stimulus values to be applied to the computer component 
obj ect . 

34. The method of claim 27, wherein a test generator 
converts the model of the computer component object 
behavior and the stimulus values into test script. 

35. An apparatus that tests response of a computer 
component to inputs comprising: 

a modeler providing a model of the computer component 
object behavior; 

a tester providing stimulus values to be applied to 
the computer component object; and 

a test generator converting the model of the computer 
component object behavior and the stimulus values into test 
script . 

36. The apparatus of claim 35, wherein the object behavior 
of a graphical user interface (GUI) is said computer 
component object behavior. 

37. The apparatus of claim 35, wherein the object behavior 
of computer software is said computer component object 
behavior . 
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38. The apparatus of claim 35, wherein the object behavior 
of computer hardware is said computer component object 
behavior . 
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ABSTRACT OF THE DISCLOSURE 

This invention relates to an apparatus and an 
associated method that tests the response of a computer 
5 component to inputs. The apparatus includes a modeler, a 
tester, and a test generator- The modeler provides a model 
of the computer component object behavior. The tester 
provides stimulus values to be applied to the computer 
component object. The test generator converts the model of 
10 the computer component object behavior and the stimulus 

values into test script. The test script can be executed 
by an automated test executor. 
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IN THE UNITED STATES 
PATENT AND TRADEMARK OFFICE 

Declaration and Power of Attorney 
As the below named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below next to 
my name. 

I believe I am the original, first and sole inventor of the subject matter which is 
claimed and for which a patent is sought on the invention entitled TEST 
GENERATOR FOR CONVERTING A MODEL OF COMPUTER COMPONENT 
OBJECT BEHAVIOR AND STIMULUS VALUES TO TEST SCRIPT the 

specification of which is attached hereto. 

I hereby state that I have reviewed and understand the contents of the above 
identified specification, including the claims, as amended by an amendment, if any 
specifically referred to in this oath or declaration. 

I acknowledge the duty to disclose all information known to me which is 
material to patentability as defined in Title 37, Code of Federal Regulations, 1.56. 

I hereby claim foreign priority benefits under Title 35, United States Code, 119 
of any foreign application(s) for patent or inventor's certificate listed below and have 
also identified below any foreign application for patent or inventor's certificate having 
a filing date before that of the application on which priority is claimed: 

None 

I hereby claim the benefit under Title 35, United States Code, 120 of any 
United States application(s) listed below and, insofar as the subject matter of each of 
the claims of this application is not disclosed in the prior United States application in 
the manner provided by the first paragraph of Title 35, United States Code, 112, I 
acknowledge the duty to disclose all information known to me to be material to 
patentability as defined in Title 37, Code of Federal Regulations, 1.56 which became 
available between the filing date of the prior application and the national or PCT 
international filing date of this application: 

None 

I hereby declare that all statements made herein of my own knowledge are 
true and that all statements made on information and belief are believed to be true; 
and further that these statements were made with the knowledge that willful false 
statements and the like so made are punishable by fine or imprisonment, or both 
under Section 1001 of Title 18 of the United States Code and that such willful false 
statements may jeopardize the validity of the application or any patent issued 
thereon. 
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I hereby appoint the following attorney(s) with full power of substitution and 
revocation, to prosecute said application, to make alterations and amendments 
therein, to receive the patent, and to transact all business in the Patent and 
Trademark Office connected therewith: 



Thomas J. Bean (Reg. No. 44528) 

Lester H. Birnbaum (Reg. No. 25830) 

Richard J. Botos (Reg. No. 32016) 

Jeffery J. Brosemer (Reg. No. 36096) 

Kenneth M. Brown (Reg. No. 37590) 

Donald P. Dinella (Reg. No. 39961) 

Guy Eriksen (Reg. No. 41736) 

Martin I. Finston (Reg. No. 31613) 

William S. Francos (Reg. No. 38456) 

Barry H. Freedman (Reg. No. 26166) 

Julio A. Garceran (Reg. No. 371 38) 

Jimmy Goo (Reg. No. 36528) 

Anthony Grillo (Reg. No. 36535) 

Stephen M. Gurey (Reg. No. 27336) 

John M. Harman (Reg. No. 38173) 

Matthew J. Hodulik (Reg. No. 36164) 
Michael B. Johannesen (Reg. No. 35557) 

Mark A. Kurisko (Reg. No. 38944) 

Irena Lager (Reg. No. 39260) 

John B. Maclntyre (Reg. No. 41 170) 
Christopher N. Malvone (Reg. No. 34866) 

Scott W. McLellan (Reg. No. 30776) 

Martin G. Meder (Reg. No. 34674) 

John C. Moran (Reg. No. 30782) 

Michael A. Morra (Reg. No. 28975) 

Gregory J. Murgia (Reg. No. 41209) 

Claude R. Narcisse (Reg. No. 38979) 

Joseph J. Opalach (Reg. No. 36229) 

Neil R. Ormos (Reg. No. 35309) 

Eugen E. Pacher (Reg. No. 29964) 

Jack R. Penrod (Reg. No. 31864) 

Gregory C. Ranieri (Reg. No. 29695) 

Scott J. Rittman (Reg. No. 3901 0) 

Ferdinand M. Romano (Reg. No. 32752) 

Eugene J. Rosenthal (Reg. No. 36658) 

Bruce S. Schneider (Reg. No. 27949) 

Ronald D. Slusky (Reg. No. 26585) 

David L. Smith (Reg. No. 30592) 

Ozer M. N. Teitelbaum (Reg. No. 36698) 

John P. Veschi (Reg. No. 39058) 



04/00 



3 



Hess 2 



David Volejnicek 
Charles L. Warren 
Jeffrey M. Weinick 
Eli Weiss 



(Reg. No. 29355) 
(Reg. No. 27407) 
(Reg. No. 36304) 
(Reg. No. 17765) 



I hereby appoint the attorney(s) on ATTACHMENT A as associate attorney(s) 
in the aforementioned application, with full power solely to prosecute said 
application, to make alterations and amendments therein, to receive the patent, and 
to transact all business in the Patent and Trademark Office connected with the 
prosecution of said application. No other powers are granted to such associate 
attorney(s) and such associate attorney(s) are specifically denied any power of 
substitution or revocation. 



Full name of sole inventor (or 1st joint inventor): Gary C. Hess 



Residence: 18 Troon Court, Lincroft, New Jersey 07738 
Citizenship: U.S.A. 

Post Office Address: Same as Above 

Full name of 2nd joint inventor: 
Inventor's 

signature . 

Residence: 
Citizenship: 
Post Office Address: 



Inventor's 
signature. 




Date A/3//> 
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ATTACHMENT A 



Attorney Name(s): EamonJ.Wall Reg. No.: 39,414 

Raymond R. Moser, Jr. 34,682 

Kin-Wah Tong 39,400 

Wan Yee Cheung 42,410 

Glenn B. Foster 32,676 



Telephone calls should be made to GLENN B. FOSTER at: 
Phone No.: 732-530-9404 
Fax No.: 732-530-9808 



All written communications are to be addressed to: 

THOMASON, MOSER & PATTERSON, LLP 
595 Shrewsbury Avenue, Suite 100 
Shrewsbury, New Jersey 07702 
Attention: Glenn B. Foster 
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